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1 . AA inspection system comprising: 

(a) a database having stored therein a package library; 

(b) r an inspection plan generator coupled to receive information from said database and 
for generating an inspection plan; 

(c) an image processing system including an image capture processor, an image 
processor and; and 

(d) an inspection \nodule, coupled to said image processing system, said inspection 
module including: 

an image model processor; 
a structural model Wocessor; and 
a geometric model processor. 

2. The system of Claim 1 ^(herein said image model processor comprises: 
an image model; and 

means for applying the ima&e model to an image of an object being inspected to 
determine if the part being inspected\looks like parts that have been seen in the past . 



1 3. The system of Claim 2 wherein tl^e at least one attribute corresponds to one of 

2 color or luminance. 
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The system of Claim 3 wherein said im^ge model comprises at least one attribute 
arranged in a fixed spatial manner. 



1 5. The system of Claim 1 wherein said structural model processor comprises; 

2 a structural model; and 

3 means for applying said structural model to an ii^age of an object being inspected 

4 to determine whether a part exists in the image that has th\same structure as that encoded 

5 in said structural model 
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1 6. The\system of Claim 5 wherein said structural model comprises 

2 a set\of regions; and 

3 a set of relations between predetermined ones of the set of regions. 

1 7. f The systeta of Claim 6 wherein a set of relations included in the structural model 

2 includes rerative color relations between predetermined regions of the structural 

3 model. \ 

1 8. The system orOaim 1 wherein said geometric model processor comprises: 

2 a geometric moMel; and 

3 means for applying the geometric model to an image of an object being inspected 

4 to determine part placement details. 

f=1 \ 

Jjj 1 9. The system of Claim k wherein said means for applying the geometric model to an 

^ 2 object comprises means for searching for one or more edges or one or more gradient 

0 \ 

Ul 3 regions of the object with the constraint that the pattern of the one or more gradients 

Hj \ 

4 match a top level configuration. \ 

« \ 

Q 1 10. The system of Claim 9 whereiX said geometric model utilizes gradients in at least 

01 " \ ------ 

n\ 2 one of luminance or color to precisely locate the object being inspected. 
W 1 \ 

Q 1 11. The system of Claim 9 wherein saio\means for searching includes means for 

2 simultaneously searching for one or more edges or one or more gradient regions of the 

3 object. \ 

1 12. The system of Claim 1 wherein said inspection module comprises: 

2 a learn model processor for learning and saving attributes about the appearance of 

3 parts and for generating image, structural and geometrrc models from data gathered and 

4 wherein said inspection module is adapted to -update one or more of 

5 predetermined image, structural and geometric models witK models generated by said 

6 learn model processor. \ 
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13. Tha system of Claim 1 wherein said inspection module comprises: 

a background model processor for learning and saving attributes about the 
appearance oft parts and for generating image, structural and geometric models from data 
gathered during an inspection process; and 

r wherein said inspection module is adapted to dynamically update one or more of 
predetermined image, structural and geometric models with models generated by said 
background model processor. 

14. The system of Claim 13 wherein in response to a new model or set of models being 
learned for an object, said inspection module substitutes one or more of said new model or 
set of models for a corresponding model or models in the inspection plan. 

15. The system of Claim \2 wherein said new model or set of models include at least 
one of an image model, a structural model and a geometry model for an object being 
inspected. \ 

16. The system of Claim 1 furtlver comprising a theta estimator for reducing the range 
of angles over which a model is applied. 



17. A method for inspecting an object comprising the steps of: 

(a) applying a first model having a first set of attributes to a region of interest around 
the object; and \ 

(b) applying a second model to the regionNpf interest around the object, wherein the 
second model has a second set of attributes wherein the second set of attributes 
differs from the first set of attributes by at\east one attribute. 

18. The method of Claim 1 7 further comprising tWe step of: 

(c) applying a third model to the region of interest around the object. 

19. The method of Claim 17 wherein: \ 



52 



2 
3 



4 



the first model corresponds to one of an image model and a structural model; and 
the second model corresponds to one of a structural model and a geometry model. 



1 20. r The methodW Claim 17 wherein the step of applying the first model reduces the 

2 number of parameters considered by the second model. 

1 21. The method of Cf^im 20 wherein the parameters are rotation and translation of the 

2 object. 
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1 22. The method of Claim 1& wherein: 

2 the step of applying a firs\model comprises the step of applying an image model to 

3 the region of interest; 

4 the step of applying a second \nodel comprises the step of applying a structural 

5 model to the region of interest; and 

6 the step of applying a third mode\comprises the step of applying a geometry 

7 model to the region of interest. 



1 23. 

2 
3 



The method of Claim 22 wherein the srep of applying an image model comprises 
the step of applying the image model to aregion to determine if an object being 
inspected looks like objects on which the rnpdel has been trained. 



1 24. The method of Claim 22 wherein the step of applying a structural model comprises 

2 the step of applying the structural model to determine whether an object exists in 

3 the region of interest that has the same structure asythat encoded in the structural 

4 model. 



1 25. The method of Claim 22 wherein the step of applying a geometry model comprises 

2 the step of applying the geometry model to precisely locatk the object and to 

3 provide detailed information concerning the placement of thaobject. 
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1 26. T*he method of Claim 17 further comprising the steps of : 

2 (d) priot to applying the first model, annotating a package library; 

3 (e) generating an inspection plan; 

4 (f) implementing a learning process; 

5 (g) r applying the first model to a test data set; and 

6 (h) applying tme second model to the test data set. 

1 27. The method oKciaim 26 further comprising the step of applying a third model to 

2 the test data sen 
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1 28. The method of Claim 26 wherein said learning process comprises the steps of: 

2 selecting from a set ofynodel types at least one model for a part type; 

3 applying each of the at l^ast one models to one or more placed images of the same 

4 part type; 

5 computing a placed imageWore between each of the one or more selected 

6 models and each placed image in a region of interest; 

7 applying each of the one or motfe models applied to the placed images of the same 

8 part type to all paste images of the same, part type; 

9 computing a paste image score between each of the one or more models and each 
paste image in the region of interest; 

computing a separation function to provide an indication of the effectiveness of the 
model; and 

in response to the separation function presiding an indication that the model is 
effective, saving the model for later use. 



1 29. A method of learning models in an inspection system, the method comprising the 

2 steps of: 

3 (a) selecting from a set of model types at least two models for an object class; 

4 (b) applying each of the at least two models to one or rr^ore example images which 

5 have been labeled as a true positive example; 
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(c) ^computing a positive score between each of the one or more selected models and 
eafch image labeled as a positive example; 

(d) applying each of the two or more models applied in step (b) to one or more 
example images which have been labeled as a true negative example images; 

(e) r computing a negative score between each of the one or more models and each 

image labeled as a negative example; 
(£) computing a separation function to provide an indication of the effectiveness of the 
model; and \ 

(g) in response to theNseparation function providing an indication that the model is 
effective, saving theVmodel for later use. 

30. The method of Claim 2^wherein each of the at least one models includes one or 
more parameters, each of the oneW more parameters having a value wherein the method 
further comprises the steps of changing at least one of the parameter values and repeating 
steps (b) through (g). \ 

3 1 . The method of Claim 29 whereinVfter the step of computing a negative score, the 
method comprises the steps, of \ 

performing the step of checking for outlier scores; and 

in response to an outlier being identified performing the step of determining the 
reason for the outlier. \ 

32. The method of Claim 29 wherein the model is at least one of: 
an image model; \ 

a structural model; or \ 
a geometry model. \ 

33. The method of Claim 29 wherein the method include!! a plurality of models and 
each of the plurality of models is learned independently^ 
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34. The method of Claim 29 wherein the method includes an image model and a 
structural model and the image and structural models are learned together. 



1 35. The me\hod of Claim 29 wherein at least one of the one or more example images 

2 represents a preoetermined defect. 

1 36. A method for updating models during an inspection of an object, the method 

2 comprising the steps of: 

3 (a) applying a plurality of models to an image of an object being inspected to obtain a 

4 result as part of an inspection process; 

5 (b) determining whether one or more of the models provides an unacceptable result 

6 for an object; \ 

^ 7 (c) in response to one or n\ove of the models providing an unacceptable result, 

G 1 8 performing a debug learning process; and 

yi 9 (d) after completing the debu&learning process, updating an inspection plan by 



W i 37. The method of Claim 36 wherein each of the new model or set of models for a 



Q 2 component has been learned in a backgrouncKmodel build step. 

1 38. The method of Claim 36 wherein the debuug learning process results in one of a 

2 revised specific model or a set of models for that pVt for which one or more of the models 

3 provides an unacceptable result. \ 

1 39. The method of Claim 36 wherein the updated models are used in the inspection 

2 process. \ 

1 40. A method of manufacturing a printed circuit board comprising the steps of: 




replacing the model or set of modelafor the problem component with a new debugged 
model thereby substituting a new mocrel for each of the one or more models in the 
inspection plan. \ 
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2 (a) nerforming at least one step in a printed circuit board manufacturing process; 

3 (b) inspecting an object on the printed circuit board by applying a first model to a 

4 region of interest around the object and applying a second different model to the same 

5 region of interest around the object; 

6 (c) f learning updated models in a background model learn process during the 

7 inspecting step, wherein the updated models can replace at least one of the first and 

8 second models usetd in the inspecting step. 

1 41. The method of Claim 40 further comprising the step of: 

2 (d) applying a thirdVnodel to the region of interest around the object. 

1 42. The method of Garni 41 wherein: 

2 the first model corresponds to one of an image model and a structural model; and 

3 the second model corresponds to one of a structural model and a geometry model. 

1 43. The method of Claim 42 wherein: 

2 the step of applying a first model comprises the step of applying an image model to 

3 the region of interest; \ 

4 the step of applying a second moidel comprises the step of applying a structural 

5 model to the region of interest; and \ 

6 the step of applying a third model comprises the step of applying a geometry 

7 model to the region of interest. \ 

1 44. The method of Claim 43 wherein: \ 

2 the step of applying an image model comprises the step of applying the image 

3 model to a region to determine if an object being inspected looks like objects on which the 

4 model has been trained; \ 

5 the step of applying a structural model comprisesuthe step of applying the 

6 structural model to determine whether an object exists in tiae region of interest that has the 

7 same structure as that encoded in the structural model; and \ 
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the &ep of applying a geometry model comprises the step of applying the geometry 
model to precisely locate the object and to provide detailed information concerning the 
placement of thV object. 

45. f An inspection system comprising: 

(a) an image processing system; 

(b) a structural model processor adapted to cooperate with said image processing 
system; \ 

(c) a geometric model processor adapted to cooperate with said image processing 
system; and \ 

(d) a learn model processor, Vlapted to cooperate with said image processing system, 
said learn model processor for learning and saving attributes about the appearance of 
objects and for providing structural a\d geometric models from data gathered during an 
inspection process. \ 

46. The inspection system of Claim 45 wherein said learn model processor provides 
structural and geometric models by updating Wisting structural and geometric models 
with attributes generated by said learn model processor. 



47. The inspection system of Claim 46 wherein said structural model processor 
reduces the number of parameters considered by said geometric model processor. 

48. The inspection system of Claim 46 wherein said leVn model processor evaluates a 
plurality of values for a plurality of parameters in each of a Structural model and a 
geometric model and said learn model processor determines which set of values provides 
an acceptable separation function. \ 
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